During the automatic segmentation of cardiac structures in echocardiographic sequences within a cardiac cycle, the contour with weak edges can not be extracted effectively. A new approach combining Speeded Up Robust Feature (SURF) and Chan-Vese model was proposed to resolve this problem. Firstly, the weak boundary of heart chamber in the first frame was marked manually. Then, the SURF points around the boundary were extracted to build Delaunay triangulation. The positions of weak boundaries of subsequent frames were predicted using feature points matching between adjacent frames. The coarse contour was extracted using Chan-Vese model, and the fine contour of object could be acquired by region growing algorithm. The experiment proves that the proposed algorithm can effectively extract the contour of heart chamber with weak edges, and the result is similar to that by manual segmentation.